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Modelling spatio-temporal processes has become an important issue in current research. Since 
Gaussian processes are essentially determined by their second order structure, broad classes of 
covariance functions are of interest. Here, a new class is described that merges and generalizes 
various models presented in the literature, in particular models in Gneiting (J. Amer. Statist. 
Assoc. 97 (2002) 590-600) and Stein (Nonstationary spatial covariance functions (2005) Univ. 
Chicago). Furthermore, new models and a multivariate extension are introduced. 
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1. Introduction 

Spatio-temporal modelling is an important task in many disciplines of the natural 
sciences, geosciences, and engineering. Hence, the development of models for spatio- 
temporal correlation structure is of particular interest. The lively activity in this field of 
research has become apparent through various recent reviews of known classes of spatio- 
temporal covariance functions (Gneiting et al. (2007), Mateu et al. (2008), Ma (2008)). 
To categorise these classes, different aspects have been considered. Gneiting et al. (2007) 
distinguish between the properties of covariance functions, such as motion invariance, 
separability, full symmetry, or conformity with Taylor's hypothesis. Another classifica- 
tion is based on the construction principles (Ma (2008)), such as spectral methods (Stein 
(2005a)), multiplicative mixture models (Ma (2002)), additive models (Ma (2005c)), turn- 
ing bands upgrade (Kolovos et al. (2004)), derivatives and integrals (Ma (2005b)), and 
Gneiting's (2002) approach, see also Stein (2005c) and Ma (2003). 

Surprisingly, some rather different approaches to the construction of spatial and spatio- 
temporal covariance models can be subsumed in a unique class of normal scale mixtures, 
which is a generalization of Gneiting's (2002) class. As its construction is based on cross 
covariance functions, Section 2 illustrates some of the properties of cross covariance func- 
tions and cross variograms. In Section 3, Gneiting's class itself is generalized. Section 4 
introduces two new classes of spatio-temporal models. Section 5 presents an extension 
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to multivariate models. In addition to the two-dimensional realisations illustrated below, 
three-dimensional realisations are available in the form of films at the following website: 
www.stochastik.math.uni-goettingen.de/data/ bernoulhlO/. 

2. Background: Cross covariance functions 

Here we introduce some basic notions and properties of cross covariance functions 
and cross variograms. See Wackernagel (2003) for a geostatistical overview and 
Reisert and Burkhardt (2007) for some of the construction principles of multivariate 
cross covariance functions in a general framework. 

Let Z{x) = {Zi{x), . . ., Zm{x)), X G M'^, be a zero mean, second order m-variate, com- 
plex valued random field in , that is, Yai Zj{x) exists and KZj{x) = for all a; G R'' 
and J = 1, . . . , m. Then, the cross covariance function C : M^"* — > C™^™ is defined by 

Cjk (x, y) = Cov(Z, {x),Zk{y)), x, y € j, fc = 1, . . . , m. 

Clearly C{x,y) — C^{y^x), but C{x,y) = C^{x,y) is not valid in general. A function 
C-.R'^'^^ C"^™ with C{x,y) = C^{y,x), x,y € R'', is called positive definite if for all 
n e N, xi, . . . ,x„ e and ai, . . . ,a„ e C™, 

n n 
p=l q=l 

It is called strictly positive definite if strict inequality holds in (1) for (oi , . . . , a„) ^ and 
pairwise distinct xi, . . . ,a;„. Accordingly, we name a Hermitian matrix M g c^ix™ posi- 
tive definite, if Mv > for all v € C™, and strictly positive definite if strict inequality 
holds for v^O. 

As in the univariate case, we deriv e from Ko lmogorov's existence theorem that a func- 
tion C : R^'' — )■ C*"^™ with C{x, y) = {y, x) is a positive definite function if and only if 
a (Gaussian) random field exists with C as cross covariance function. Further, a function 
CiR^'' — R™^'" is a positive definite function if and only if Equation (1) holds for any 
ai,...,a„eR". 

The cross variogram 7 : R^'' (^ynxm ^ ^ _ (7^,.)^-;.^]^ is defined by 

7,fc(a;, y) = iE(Zj(a-) - Z,{y)){Zk{x) - Zk{y)), y € R^ j, fc = 1, . . . , m. 

If Z has second order stationary increments, then j{x,y) depends only on the distance 
vector h~x~y, that is, 7(2:, y) — ^{h) for some function 7 : R'' — > C™^™. If in addition 
Z is univariate, then 7 is called a (semi-)variogram. Schoenberg's (1938b) theorem states 
that a function 7 : R'' — > R with 7(0) = is a variogram if and only if exp(— r7) is a 
covariance function for all r > 0, see also Gneiting et al. (2001). Let us now discuss 
multivariate and non-stationary versions of this statement. To this end, we denote the 
componentwise multiplication of matrices by "*" , in particular. 
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Further, f*{A) denotes the componentwise function evaluation, for example, 

exp*(A) = (exp(Ajfc))jfc. 

Theorem 1. Lei C : R^d ^ c™^™ and xm be the mxm matrix whose components 
are all 1. 

1. The following three assertions are equivalent: (i) C is a cross covariance function; 
(ii) exp*(rC) — Emxm is a cross covariance function for all r > 0; (iii) sinh*(rC) 
is a cross covariance function for all r > 0. 

2. //cxp* (rC) is a cross covariance function for all r>0 then 

C(^) (x, y) = C{z, z) - C{x, z) - C{z, y) + C{x, y) (2) 

is a cross covariance function for all z G M^. If m = 1 and (2) holds for one z G , 
then exp(rC) is a covariance function for all r > 0. 

Proof. Note that the componentwise product Ci * C2 of two m-variate cross covariance 
functions Ci and C2 is again a cross covariance function. To see this, consider the com- 
ponentwise product of two independent random fields with cross covariance functions 
Ci and C2. In particular, C{x,y)™ and rC{x,y), r > 0, are cross covariance functions. 
Furthermore, the sum and the pointwise limit of m-variate cross covariance functions are 
cross covariance functions. 

1. Both functions, exp(a;) — 1 and sinh(a;), have Taylor expansion on R with positive 
coefficients only. Hence, exp*(rC) — Emxm and sinh* (rC) are cross covariance functions 
if C is a cross covariance function. On the other hand, since the Taylor expansions equal 
X + o{x) as x — >■ 0, we have that (exp*(rC) — Emxm)/''' and sinh*(rC)/r converge to C 
as r — )■ and C must be a cross covariance function. 

2. The proof follows the lines in Matheron (1972). Let ai , . . . , a„ G C™, , . . . , x„ G R'^, 
oq = ~ X!p=i '^p ^^'^ xo ~ z for some z G R''. Then 

< 1™ 2^ 2^ ftp Og ^2^2^ap C{Xp,Xg)ag 

p=Oq=0 p=Oq=0 
n n 

= '^^ap[C(xp,Xq) + C{z,z) - C{xp,z) - C{z,Xq)]aq. 

P=l 9=1 

Conversely, assume that to = 1 and Equation (2) holds. Since Co{x,y) = f{x)f{y) is 
a covariance function for any function /:M'^ — >■ C (Berlinet and Thomas- Agnan (2004), 
Lemma 1) part 1 of the theorem results in 

exp(rC(x,y)) = f (x) f (y) exp{rC {x , y) + rC{z, z) ~ rC{x, z) ~ rC{z,y)) 

being a positive definite function for any r > and f{x) = exp(rC(a;, z) — rC{z, z)/2). □ 
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Remark 2. If m = 1, C{x,y) = — 7(x — y) and z = 0, then C^^^ in Equation (2) equals 
the covariance function of an intrinsicahy stationary random field Z with Z{0) = al- 
most surely, that is, part 2 of Theorem 1 yields Schoenberg's (1938b) theorem. If m > 1, 
the reverse statement in part 2 of Theorem 1 does not hold in general, as the following 
example shows. Let M G E™^™, m > 2, be a symmetric, strictly positive definite matrix 
with identical diagonal elements, 7 iM'' — > M a variogram, and C{x,y) = —M'y{x — y). 
Then C(°)(x,y) given by (2) is a cross covariance function, but exp*(— M7) is a positive 
definite function if and only if 7 = 0. To see this, assume that exp*(— M7) is a posi- 
tive definite function and let m = 2, M = {Mjk)j^k=i,2, and Z{x) = {Zi{x), Z2{x)) be a 
corresponding random field. Then with a = (1, —1, 1, —1)^ we have 

= 2(l,-l)exp*(-A/7(y))(l,-l)T 

Since Mu > M12, the latter is non-negative if and only if j{y) = 0. 

So, for an arbitrary cross variograms 7:R^'^ — >■ C™^™ the function exp*(— 7(x,y)) is 
not a positive definite, in general. However, 

Ci {x, y) = exp* (7(a;, 0) -I- 7(y, 0) - 7(x, y)) 

and 

C2{x,y) = exp*(7(a;,0) -|-7(y,0) - D^y - 7(0;, y)), 

(3) 

{Dxy)jk =7jj(a;,0)-t-7fefc(y,0), 

are always positive definite functions in R'', cf. Theorem 2.2 in Berg et al. (1984) for the 
univariate case. To see this, let 7 be an m-variate cross variogram and Z a corresponding 
m-variatc random field. Let Y{x) = Z{x) — Z{Q) and c{x,y) ^ EY {x)Y^ (y) . Then c and 
are positive definite functions and 

Cjk{x,y) + y)=E{Y,{x)Yk{y) + Yk(x)Y,{y)) 

= E[Y, (z)nR + Y, iy)n^) + ( (x) ~ Y, (y)) ( W - yi^)] 

= ijkix^O) + jjkiy, 0) - jjkix, y). 

Part 1 of Theorem 1 yields that Ci is a positive definite function. Let Z he a corresponding 
random field. Then the random field (e-'>'"(^'°)Zi(a;), . . . , e-'^"""(^^°)Z™(x)), x G R'^, has 
cross covariance function C2. 

Remark 3. Let C(a;i, 3:2) = VD{xi,X2)V^ G {^mxm^ x,y G M'', for some unitary matrix 
V e C™^™. The values of the mapping D :R^'' — > C™^™ are diagonal matrices. 



D{xi,X2) = dia.g{Di{xi,X2), ■ . ■ , Drnixi,X2)), xi,X2 els'*. 
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and the Dj : M. — > C, j = 1, . . . , m, are arbitrary functions. Then the n-fold matrix prod- 
uct C" : M^'' — ?> (^mxrn cross covariance function in M.'^ for any n G N if and only if the 
Dj are all covariance functions, and Theorem 1 remains true if exp* {rC{x,y)) is replaced 

by 

exp(rC(x, y))^Y. """^"^^^ ' x,yeR'. 

n=0 



The subsequent proposition generalizes the results in Cressic and Huang (1999) and 
Theorem 1 in Gneiting (2002). Denote by B'^ the ensemble of Borel sets of R"*. 

Proposition 4. Let d and I be non-negative integers with d + I > and C : ]R'+^'' — > 
(^mxm ^ continuous function in the first argument. Then the following two assertions 
are equivalent: 

1. C is a cross covariance function that is translation invariant in the first argument, 
that is, C{h,yi,y2) = Gov{Z(x-\-h,yi), Z{x,y2)) for some second order random field 
Z on and all x, /i G K' and yi,?/2 G K''- 

2. C:K' X M?'^ — !■ C™^™ is the Fourier transform of some finite measures Fy^^y^,j^j^, 

2/2 G R'^; j,k = 1, . . . , m, that is, 

C,kih,yuy2) = Je-'^''^^^Fy,^y,^,^kidLo), /i e R', j, fc = 1, . . . , m, (4) 

and 

{Cfk{yi,y2))jk = {Fy,,y,,jAA))jk, yi,2/2 G R'', (5) 
is an m-variate cross covariance function in R'' for any Ag 



Proof. The proof follows the lines in Gneiting (2002). Let us first assume that Equa- 
tions (4) and (5) hold. Let n eN, a;i , . . . , a;„ G R' , j/i , . . . , y„ G R"* and ai , . . . , a„ G C™ 
be fixed. Then a matrix-valued function /:R'+-^'^ (^mxm ^ non-negative finite 
measure F on R'^ exists, such that 

/ .fjkii^,yp,yq)F{duj) ^ Fy^^y^^j^kiA), p,g = l,...,n,j,fc = l,...,m, (6) 
J A 

for any A & B'' . For instance, let F{A) =Ylp=iY.T=iFvp,yp,k,k{A). Then, Equation (5) 
implies that the mn x mn matrix {fjki'-^,yp,yq))j,k-p,q is hermitian for _F-almost all cj. 
Now, 

n n ^ n n 

^^aJC(xp-x„2/p,2/,)a^= / ^ ^ c-'<^-^'^^ aj f{uj, y^, 2/,)e-'<--")a^i^(d^) > 0. 

p—1 q—1 p—1 q—1 
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Conversely, let C(/i, yi, 2/2) (^mxm covariance function that is stationary 

in its first argument. We have 

C,k {h, y, y') = J e-'<'^'''>i^y,^,.,- fe(dc^), h eR';y,y' eR'',j,k ^1, . . . ,m, 

for some finite, not necessarily positive measures Fy^y>j^k (Yaglom (1987b), page 115). 
It now remains to demonstrate that equality (5) holds. Fix n G N, . . . , y„ G R*^, and 
fli, . . . , a„ G C™. Then a non-negative finite measure F and a function / : — > C™^™ 
exist, such that Equation (6) holds. By assumption, J/p' y?)^ ^ 

positive definite, continuous function and its Fourier transform is non-negative. Following 
directly from the linearity of the Fourier transform, we have that for F-almost all w G 

n n 
p=l q=l 

which finally leads to Equation (5). □ 

If a covariance function is translation invariant, we will write only one argument for 
ease of notation, for example, C{h), h = x — y£M.'^, instead of C{x,y), x,yGM.'^. 



3. Generalized Gneiting's class 

A function C{x, y) ~ Lp{\\h\\) , h ~ x — y ^ Mf'- , is a motion invariant, real- valued covariance 
function in M'' for all d G N if and only if is a normal scale mixture, that is. 




cxp{~ah'^)dF{a), h>0, 



for some non-negative measure F (Schoenberg (1938a)). Examples are the stable model 
(Yaglom (1987a)), the generalized Cauchy model (Gneiting and Schlather (2004)), 

ip{h) = {i + h"'y^/°', h>o, 

a G [0,2], /3 > 0, and the generalized hyperbolic model (Barndorff-Nielsen (1979), 
Gneiting (1997)). The latter includes as special case the Whittlc-Matcrn model (Stein 
(1999)), 

^{h) = W^{h) = 2^-''V{v)-^h''K^{h), h>0. 
Here, > and /i^ is a modified Bcssel function. 

Theorem 5. Assume that m and d are positive integers and H : M."^ — > R™. Suppose that 
if is a normal scale mixture and G : R^*^ — > R"'^™ is a cross variogram in R'' or —G is a 



786 



M. Schlather 



cross covariance function. Let M G R™^™ be positive definite, such that M + G{x, y) is 
strictly positive definite for all x,y G M.'^. Then 

-'r, - ^([(^(-) - + ' ^(^))]^^^) , .,,.r^ (7) 

^\M + Gix,y)\ 

is a covariance function in Mf^. 

Lemma 6. Let 7 : M^'^ ^ C'"^'" be a cross variogram (cross covariance function) in 
M.'^ and A G C'^"'. Then 70 = A'yA^ is an l-variate, cross variogram (cross covariance 
function) in M''. 

Proof of Theorem 5. We follow the proof in Gneiting (2002) but assume first that 
(p{h) —c^'^ . If G{x,y) is a cross variogram, then, according to Lemma 6, 

g{x,y)^uj^G{x,y)uj 

is a (univariate) variogram for any lo G M™. Equation (3) or Theorem 2.2 in Berg et al. 
(1984) implies 

a(x,y)=exp(-w^G(a;,y)t^), x,yGR^ (8) 

and hence, 

C{uj,x,y)=cyi^{^Lo^{M + G{x,y))uj), x.yGW^, (9) 

are both covariance functions for any fixed w G M™. With dFx,y,i^i{Lo) = (^(cj, x, y) dw. 
Proposition 4 yields that the univariate function 

C{K X, y) = ..-M~h^{M + G{x^y))-^h) ^ ^ 
^\M + G{x,y)\ 

is a covariance function in R™+'' for all c > 0, which is translation invariant in the first 
argument. Now, consider a random field Z(C,a;) on M'"+'^ corresponding to C{h,x,y) 
with c = 1 . Define the random field Y on M.'^ by 

Y{x)^Z{H{x),x). 

Then the covariance function of Y is equal to the covariance function given in the theorem. 
For general ip, the assertion is obtained directly from the definition of normal scale 
mixtures. In case — G is a cross covariance function, the proof runs exactly the same 
way. □ 

Example 7. A well known construction of a cross covariance function in used in 
machine learning is 

G(x,y) = /(a;)/(2/)T, a;,yeM^ 
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for some function / : K'' — > M™^'. Assume that M — f{x)f{y)^ is strictly positive definite 
for all X and y and some positive definite matrix M. Then, C in Equation (7) is a 
covariance function with G ~ —G. 

We denote by IrfxdGM''^'^ the identity matrix. 

Example 8. Gneiting (2002) delivers a rather general construction of non-separable 
models based on completely monotone functions, containing as particular case the models 
developed by Cressie and Huang (1999). Let iphe a. completely monotone function, that 
is, ^{t^), i €: K, is a normal scale mixture, and -0 be a positive function with a completely 
monotone derivative. Then 

g(fe,^) = ^(l^p)d/2 ^(ll^llV^(l"l'))' /ieM^^^GR, (10) 

is a translation invariant covariance function in W^^^ (Gneiting (2002), Theorem 2). 
According to Bernstein's theorem, the function • |p) — c is a variogram for some 
positive constant c, see also Berg et al. (1984). The positive definite nature of C in (10) 
is also ensured by Theorem 5 for m = d and G{{xi,X2), (j/1,2/2)) = 'ip{\\x2 - y2|P)ldxd, 
S K'', 2:2,2/2 S IR- Gneiting (2002) provides examples for ijj and, along the way, 
introduces a new class of variograms, 

7(/i) = (||/ir + 1)^-1, as (0,2],6e (0,1]. 

This class generalizes the class of variograms of fractal Brownian motion and that of 
multiquadric kernels (Wcndland (2005)). 

Example 9. In the context of modelling rainfall. Cox and Isham (1988) proposed in 
R'*'*'^ the translation invariant covariance function 

C{h,u)^¥.vLp{\\h-Vu\\), /iGK'^,ueM. 

Here, iy9(|| • ||) is a motion invariant covariance function in and is a d-dimcnsional 
random wind speed vector. Unfortunately, this appealing model has lacked explicit repre- 
sentations. Now let us assume that V follows a d-variate normal distribution Af{iJ.,D/2) 
and ip{x) =exp(— a;^). Then, 

C{h, u) = „ ^ ^ M [{h - uM)^(ldxd + u^D)-\h - u^i)Y'^), G u e M, 

please refer to the appendix for a proof. Hence, C{h, u) above is a covariance function for 
any normal mixture ^p. Figure 1 provides realizations of a random field with the above 
covariance function where ip = W\ is the Whittle-Matern model, ^ = (1,1) and 
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Remark 10. Stein (2005b) proposes models in M*^ of the form 

V\m + fiy)\ 

in which the values of /iR^"* — > R™^™ are strictly positive definite matrices, see also 
Paciorek (2003) and Porcu et al. (2009). Here, f{x) + f{y) is not a variogram in general, 
but the proof of Theorem 5 is still applicable if C in Equation (9) is replaced by 

(7(w, X, y) ^ cxp{-u}'^{f{x) + f{y))uj), 

which is a positive definite function for all ut E M™ . 

Remark 11. The covariance model (7), which is valid in E'', does not allow for negative 
values, hence its value is limited in some applications (Gregori et al. (2008)). To over- 
come this limitation, Ma (2005a) considers differences of positive definite functions. Let 
Bi,B2,Mi,M2 € R'''^'^ be strictly positive definite matrices. Proposition 4 yields that 

, exp(-[/t^(Mi + jx - y)^Bi{x - y)ld^dr'h]) 
C[n,x,y) = , 

^\M, + {x-yVB,{x-y)U^d\ 
,.eM-[h-iM2 + ix-yVB2ix-y)U.,)-^h]) 
^\M2 + (x - yV B2ix ~ y)ld>,d\ 

is a positive definite function in M^'' that is translation invariant in its first argument if 
and only if for all a; S M'' , 

Cu;{x,y) = exp{-uj'^ Miuj - \\u;\\^{x - yy Bi{x - y)) 

+ bexp{-uj'^M2Uj - \\iu\Wx - yyB2{x - y)), x,y E R\ 





Figure 1. Realizations of the Cox-Isham covariance model in 9? X K. Left time t = Q, right 
X2 ~ 0. See Example 9 for details. 
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is a positive definite function, tliat is, if and only if for all w,^ € R , 

This is true for some negative value of b if and only if both AI2 — Mi and — -Bf ^ are 
positive definite matrices. In this case, C{h, x, y) : E'''^' M is a positive definite function 
in M^'' if and only if 

Then, Cq given by Co(a;, y) = C{x — y, x, y) is a stationary covariance function in that 
may take negative values. 

Remark 12. The condition that M + G{x,y) is strictly positive definite for all x,y G 
R'' can be relaxed. For example, let d = 2 and {h, u) = x — y G M."^ . Then, the function 
C{h,u) = exp(— is of the form (7) and defines a covariance function of a 

stationary, generalized random field on R^, see Chapter 3 in Gel'fand and Vilenkin (1964) 
and Chapter 17 in Koralov and Sinai (2007). Note that, here, lim„_^o C(0,u) = 00. Hence, 
C cannot be a translation invariant covariance function in the usual sense. 

4. Model constructions based on dependent processes 

The idea of the subsequent two constructions is based on the following observation. Let 
C{h,u) = Co{h)Ci{u), h gW^, u € R, be a translation invariant, real- valued covariance 
model in R'*"''^ and assume we are interested in the corresponding random field at some 
fixed locations xi, . . . ,x„ G R'' and for all t G R. Let Yx, x G W^, be i.i.d. temporal pro- 
cesses with covariance function Ci . Then 

Z{t) = (Z,, it), . . . , it)) = {Coixp - x,))'J]^,_jYx, (t), . . . , {t}y, t e R, 

has the required covariance structure. Now, Z can be interpreted as a finite, weighted 
sum over Y^, x . The separability is caused by the fact that Y enters into the sum 
only through the fixed instance t. Non-separable models can be obtained if the argument 
of Y also depends on the location. 

4.1. Moving averages based on fields of temporal processes 

Assume that Y{A^t), AgB'^ and f e R', is a stationary process such that Y{Ai, ■)t ■ ■ , 
Y[Am-) are independent for any disjoint sets Ai,...,An G B"^, n G N. In the second 
argument, y is a stationary, zero mean Gaussian random field on R' with covariance 
function \A\Ci, Ci :R' ^M. Then, 



Cov(r(A, t), Y{B, s)) = \An B\Ci{t - s) 



790 



M. Schlather 




02468 10 02468 10 

X, x. 



Figure 2. Realizations of a moving average random field in x R. Left time t — 0, right X2 — 0. 
See Example 13 for the definition of the covariance structure. 

for any s,teR^ and A,B eB"^. Let / : M'^ M' be continuous, g : M'' -> M be continuous 
and squarc-intcgrablc, and 

Z{x,t)^ / g{v~x)Y{dv,f{v-x)-t), xeR'^,teRK 

Then Z is weakly stationary on R'*+' with translation invariant covariance function 

C{h,u)^ I g{v)g{v + h)Ci{f{v)~ f{v + h)-u)dv, heR'^,ueR^. 

Example 13. Let g{v) = {2n-^)'^/'^cxp{-\\v\\'^), v eM.'^, I = 1, Ci{u) = cxp{-u'^), u eM., 
and f{v) = v'^ Av + v, v £ M'*, for a symmetric, not necessarily positive definite matrix 
A e M.'^^'^ and z G K'^. Let us further introduce a non-negative random scale V, that is, 

Z{x, t) = V^/^ [ g{Vv{v - x))Y{dv, Vv{f{v -x)-t)), x€R'^,teR. 

Let B = AhhJ A. Then the covariance function of Z equals 

C{h,u) = lldxrf + 2Bri/2Eve-^[ll''ll'/2+(^^''+")'(i-2''^^(i-x.+2S)-^A/.)]^ 

please refer to the appendix for a proof. Equation (11) reveals that C is a potential 
covariance model for rainfall with frozen wind direction. Figure 2 depicts realizations of 
a random field with the above covariance function where Eyexp(— V^Q) is the Whittle- 
Matern model Wi{s/Q), Q>0, (2,0) and .4 = ( ^ ?)• 

4.2. Models based on a single temporal process 

Another class of models may be obtained by considering only a single process Y . Although 
the subsequent approach might be generalized, an explicit model has currently only been 
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found within the framework of normal scale mixtures. For x S let 

Z{x) = (2y/7r)^/4|^,| V4e-^(c/-)"^^==(c/-)y(VT7(a([/ - x) + ^x)))^^. (12) 

Here, y is a positive random variable and U is a d-dimensional random variable with 
strictly positive density /. The one-dimensional random process Y is assumed to be sta- 
tionary with Gaussian covariance function C{t) = e~* . The matrix Sx is strictly positive 
definite for all a; € K'' , ^2 : K'' ^ K is arbitrary, and g is a positive function such that 
Ey(7(V,a;)^ is finite for all x E K'^. The function ^1 is quadratic, that is, 

^1 (x) = x^Mx + X 

for a symmetric d x d matrix M and an arbitrary vector z e M'* . Let 

c -z^(a; -y)+ - ^(y), 
A = S, + Sy + 4M{x - y){x - y^M, 
m = {x — y)^ M{x — y), 

and 

Q{x, y)=c^- + {x- y)^(S'^ + 2(m + c)M)A-\Sy + 2{m - c)M){x - y). 
Then the covariance function of Z equals 

C{x,y) = ' ' ^' ■l&v9{V.x)g{V,y)cM~VQ{x,y)), x^y^W^. (13) 

V 

The proof is given in the Appendix. 

Example 14- Translation- invariant models in M'' are obtained if both Sx and g do not 
depend on x. Assume Sx is twice the identity matrix, g{v) = (2-0;)^"''/ y^T{iy), 1/ > 0, 
and V follows the Frechet distribution F{v) = e~^^^^^\, v > 0. Two particular models 
might be of special interest, either because of their simplicity or their explicit spatio- 
temporal modelling. First, if c = then 

according to formula 3.471.9 in Gradshteyn and Ryzhik (2000). Second, an explicit spatio- 
temporal model in is obtained for 



S,2ix, t)=t, xeR'^,teR, and M = 



L 




792 



M. Schlather 



Then, with D = Idxd + Lhh^ L, we get 



C{h,u) ^ \D\-^^^W^{^/Q{h,u)), heR'^,ueR, 

where 

Q{h,u) = (u - - {h^Lhf + h7{D + {u- z^h)L)D-\D + {u - z^h)L)h. 

Example 15. Let = ^2 = 0. Then the random process Y{t) is considered only at 
instance t = Q and the exponent Q{x,y) simphfies to 

Q{x,y) = {x- + Sy)-'Sy{x - y) ^ {x - yV{S-' + S;Y'{x - y). 

Let g{v,x) = {2^yvy^'''^^^ /T{h'{x)y^^ , v a positive function on W^, and V a Frechet 
variable with distribution function F{v) = e~^/'-^'^\ v > 0. Then, the first model given in 
Stein (2005b) is obtained, 

The second model given in Stein (2005b), a generalization of the Cauchy model, is ob- 
tained by g{v,x) = and a standard exponential random variable V, that is, 

2^/215- 11/415- 

^ |5, + 5^|l/2(l + g(a;,y))W-)+5(l/))/2' 2/ ^ M . 

If v and S are constant, then the above models are special cases of Theorem 5. 
See Theorem 1 in Porcu et al. (2009) for a class of models that generalizes Stein's 
examples. 

Example 16. A cyclone can be mimicked if rotation matrices are included in the model, 

r)d/2|o |l/4|c 11/4 

C{x,y) = '7 W,{{h^S,{S, + Sy)-'Syhf^), x,y,eR\ 

V Pa; + Oy\ 

where 

5*:^ = diag(l, 1, 1) + R{xfA^xx'^AR{x), A e M^xs^ 

(cos(aa;3) — sin(aa;3) 0\ 
sin(ax3) cos(aa;3) , a; = (xi, X2, X3) e M^, a G M, 
ij 

and 

h = x^R{x)-y^R{y). 
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X2 = 0. See Example 16 for the definition of the covariance structure. 



The positive definiteness of the model is now ensured by both Theorem 5 and a general- 
ized version of Z in Equation (12), replacing x by x^ R{x) there. Note that x i— >■ x'^ R{x) 
is a bijection. Figure 3 depicts realizations of a random field with the above covariance 
function where a = — 27T, ^ = 1, and 




5. Multivariate spatio-temporal models 

Here, we generalize Theorem 5 to construct multivariate cross covariance functions. Let 
AI = [M + M^)/2 for any real- valued square matrix M . 

Theorem 17. Assume that I, m and d are positive integers, Aj G R'^'^ for j = 1, . . . ,m. 
Suppose that ip is a normal scale mixture and G:R^'*— >R'^' is a cross covariance func- 
tion. Let M G M.'^^'^ be a positive definite matrix such that M — Aj G{x,y)Ak is strictly 

positive definite for all x,y gM.'^ and j,k = 1, . . . ,d. Then C = {Cjk)j,k=i,...,m is a cross 
covariance function in K.'^ for 

ifilix - yYiM - A]G{x,y)Ak r\x - y)^/^) 

Cok{x,y) = . , 

^l\M- A]G{x,y)Ak \ 

x,y € M'^, j, fc = 1, . . . ,m. 

Proof. Lemma 6 yields that 

{u)^AjG{x,y)AkU!).j^k=i.,...,m = {(^^ Aj G{x,y)AkUj)j^k=i,...,Tn 



(14) 
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= {Aiuj,...,A,ni^) G{x,y){Aiuj,...,A,nUj) 

is a cross covariance function for all a; G R**. Part 1 of Theorem 1 yields that Cuj{x, y) = 
{exp{uj'^Aj G{x, y)AkUj))j,k=i,....m is also a cross covariance function. By assumption, M — 
Aj G{x,y)Ak is strictly positive definite. Hence, as a result of Proposition 4, the Fourier 

transform of the function uj i— > exp(— cj^Mcij)C(^(a;, y) is a cross covariance function, which 
is of the form (14). □ 

Appendix 

A.l. Proof for the covariance function in Example 9 

Let ffi^D/2{x) be the multivariate normal density with expectation /x and covariance 
matrix D/2. Then we get 

- log(^(/i - uv)f^^D/^{v)) + i log{{2nf\D\) 

= h^h - 2uh^v + u^i^v + v^D~^v - 2^i^ D^^v + ^.J D^^ fj. 

= h'^h + ^^Z?- V + {v - e)^(^'ldxd + D-^){v - - C{uHd>,d + D-')^ 

with ^={u'^ldxd + D-'^)-^{uh + D-^fi). Hence, 

- logC{h, u) + ^ log{\D\) + i logi\uHd>,d + D-^\) 

^{h- u/x)^(ldxd + u^D)-\h - ufi) 
which yields the assertion. 

A. 2. Proof for the covariance function in Example 13 

We proof the formula for the covariance function in Example 13, but also demonstrate 
that a slightly more general function g does not give a more general model. To this 
end, let g{v) = (|27T~-'^M|)^/'* exp(— d^Mu), v S R'', for a strictly positive definite matrix 
M eM.'^^'^. For ease of notation we assume that V =1. Then 

- \og{g{v)g{v + h)Ci{f{v) - f{v + h) - u)) - ^ log(|27t-iA/|) 
= v'^Mv + {v + hfM{v + h) + {2v^ Ah + Ah + h + uf 
= 2v^Mv + 'iv^Bv + 2v^{2B + M + 2uA + 2Ahz^)h + c 
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where B = Ahh^ A and c = [h^ Ah + h + uf + li^Mh. Hence, with D = 2B + M + 
2[u + z'^h]A, 

- \og{g{v)g{v + h)C^{f{v) - f{v + + log(|27t'iM|) 

= [v - {2M + ABy^ Dh)^ {2M + 'iB){v - {2M + ABy^ Dh) 
- h7D{2M + AB)-^Dh + c. 

Thus, 

C{h, u) = exp(-c + /i^^(2M + ^B)-^Dh), heW,ue^. 

Let Af~^/^ be a symmetric matrix with M^^/^A/A/^^/'^ = Ifixd- Replacing on the 
right hand side M''^/'^ AM~'^/'^ by A, M^^^^z by z and M^/^/j shows that M 

causes nothing but a geometrical anisotropy effect. Hence, we may assume that M is the 
identity matrix. Then 

C{h,u) = lldxd + 251-1/2 exp(-[c _ i/jT^(;^^^^ ^ 2B)-'Dh]) 
which yields Equation (11). 

A.3. Proof of Equation (13) 

Let h = X — y and w ~ U — x. Then we have 

Gov{Z{x),Z{y))^n-''^'\Sy/^\Sy\'^'EvV''^^g{V,x)g{V,y) 

X J cxp{-Vw'^ S.^w - V{w + h^Syiw + h) 

-V{uy Mw-{w + hy M{w + h) + cf)dw. 

The value of the integral is at most J gxy>{~Vvo^ Sxw) dw. Hence Cov(Z(a;), Z{y)) < oo 
ifEvg(F,x)g(F,y)<oo. Now, 

w'^S^w + {w + h^Syiw + h) + {w^Mw- {w + M{w + h) + cf 

= w^iSx + Sy+ AMhhJM)w + 2uy{Sy + 2{hJ Mh - c)M)h + Syh + [hJ Mh - cf 
= {w- ^lf A{w - fi) - ^i^A^i + Ii^Syh + {h^Mh - cf 

with ^l = -A-^{Sy + 2{h^Mh ~ c)M)h. That is, 

Cov(Z(x),Z(y)) = \A\-'/^\Sx\"'\Sy\'''lS.vg{yx)g{V,y) 

(15) 
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On the other hand, using the transform w = U ~ y, we get 

Cov(Z(a;),Z(y)) 

= 7r-'^/2 1 1 1 Sy I '/'EyV'^^giV, x)g{V, y) 

X J cxp{-V{w-hyS^{w-h) + -VhSyh (16) 
- V{{w ~ KfM{w ~h)~ vj^Mw + cf) Aw 

with V = A-i(S':r + 2{h^Mh + c)A/)/i. 

Choosing = 1 and g a constant function we obtain that the exponents in (15) and 
(16) must be equal, that is, 

hSyh + {h^Mh - cf - fi^Ai^i 

= ^[hSyh + {hJMh - cf - All + hS:,h + {hJ Mh + c)^ - v'^ Av] 

= \[h{Sy + S^ + 4:Mhh^M)h - 2{hJMhf + - (/^ - v)A{ii - v) - 2i/^A" V] 

= c2-(/iTa//i)2-i.TA-V- 
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